arXiv:astro-ph/0503519vl 23 Mar 2005 


The Rise and Citation Impact of astro-ph in Major Journals 

Travis S. Metcalfe 

High Altitude Observatory, National Center for Atmospheric Research, 
P.O. Box 3000, Boulder, CO 80307-3000 USA 


Abstract 

The rise in the use of the arXiv preprint server 
(astro-ph) over the past decade has led to a major shift in 
the way astronomical research is disseminated. Schwarz 
& Kennicutt (2004) recently found that Astrophysical 
Journal papers posted to astro-ph are cited roughly twice 
as often as papers that are not posted, suggesting that 
the preprint server has become the primary resource for 
many astronomers to keep up with the literature. I de¬ 
scribe a simple method to determine the adoption rate 
and citation impact of astro-ph over time for any journal 
using NASA’s Astrophysics Data System (ADS). I use 
the ADS to document the rise in the adoption of astro- 
ph for three major astronomy journals, and to conduct 
a broad survey of the citation impact of astro-ph in 13 
different journals. I hnd that the factor of two boost in 
citations for astro-ph papers is a common feature across 
most of the major astronomy journals. 

1 Motivation 

Schwarz & Kennicutt (2004) recently conducted a 
detailed study of papers published in the Astrophysi¬ 
cal Journal (ApJ), designed in part to document the 
adoption rate and citation impact of the arXiv preprint 
server (astro-ph; Ginsparg 2001). The database they 
constructed for this study is a rich source of demographic 
and citation information for the ApJ, but the two most 
interesting results were specific to astro-ph. They found 
that the adoption rate of astro-ph varied widely between 
subhelds of astronomy, with nearly universal adoption 
(95%) in cosmology and the lowest adoption (22%) in 
solar astrophysics and planetary science by 2002. This 
difference among subhelds is signihcant because they also 
found that papers posted to astro-ph are cited about 
twice as often as papers that are not posted. This boost 
in citation rates was more than a factor of 10 for cosmol¬ 
ogy papers, and still a factor of 1.8 for papers in solar 
astrophysics and planetary science. 

Considering the main hndings of Schwarz & Kenni¬ 
cutt about ApJ papers, I wondered whether the other 
major journals would show similar trends. Is astro-ph 
as widely used by author communities in other parts of 
the world? Does astro-ph produce a comparable impact 
on the citation rates for papers published in the other 
journals? Answering these narrow questions for a large 
sample of journals is considerably easier than the deep 
study undertaken by Schwarz & Kennicutt for the ApJ. 
The Astrophysics Data System (ADS; Kurtz et al. 2000) 
recently added links to the arXiv preprint records of jour¬ 
nal papers that have also been posted to astro-ph. This 


new feature, combined with the citation data and search 
filtering capability of ADS, allows users to measure the 
adoption rate and citation impact of astro-ph for each 
journal with just a few clicks. 

In this short paper, I document the rise in the adop¬ 
tion rate of astro-ph for three major astronomy journals 
published in North America (ApJ), the UK (MNRAS), 
and continental Europe (A&A). I also determine the ci¬ 
tation impact of astro-ph on papers published in 2002 for 
13 journals spanning the globe. I describe in section 2 
how to generate these statistics for any journal using the 
ADS, and I validate the method by comparing it to the 
Schwarz & Kennicutt sample. I present and discuss the 
main results in section 3, and I summarize the major 
conclusions in section 4. 

2 Methodology 

For any given range of dates and for any particular 
journal in the ADS, statistics on the fraction of papers 
posted to astro-ph (the adoption rate) and the resulting 
impact on the citation rate (the citation impact) can be 
generated with two simple queries. For example, gen¬ 
erating statistics that can be compared to the Schwarz 
& Kennicutt sample requires the following: (1) Enter a 
Publication Date range between 7/1999 and 12/1999. 
(2) Under the filters section Select References From, 
choose All refereed publications and type the jour¬ 
nal code “ApJ .. ” in the select/deselect publications 
held. (3) For the hrst query, set Select References 
With to A bibliographic entry (the default). For the 
second query, set it to All of the following and check 
ArXiv Preprint. (4) Under the sorting section, select 
Sort by citation count. In the query results, just 
above the bibliographic entries, the hrst query yields the 
total number of ApJ papers published in this date range 
and the total number of citations to those papers in the 
ADS database (which is not complete, but includes data 
from all of the major journals beginning in 1999). The 
second query yields the corresponding numbers for the 
subset of these papers that have also been linked to an 
astro-ph record. 

In this example, the hrst query results in Total 
number selected: 1182, Total citations: 29904, 
while the second query gives Total number selected: 
706, Total citations: 22623. This means that the 
totals for non-astro-ph papers are 476 and 7281 respec¬ 
tively. Since these queries return papers published as 
Letters and Main Journal articles together, and because 
additional citations have now been added to ADS, the 
results are not strictly comparable to the Schwarz & 
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Fig. 1.— The rise of astro-ph in three major journals published in the UK (MNRAS), North America (ApJ), and 
continental Europe (A&A). 


Kennicutt sample. Even so, the fraction of ApJ articles 
posted to astro-ph from these queries (706/1182 = 60%) 
is nearly identical to that found for Main Journal ar¬ 
ticles by themselves (61%; Schwarz & Kennicutt 2004, 
their Table 4). In addition, the mean number of cita¬ 
tions for astro-ph papers (22623/706 = 32.0) compared 
to non-astro-ph papers (7281/476 = 15.3) from these 
queries is larger by a factor of 2.09, which is similar to 
the overall factor of 2.05 found by Schwarz & Kennicutt 
(2004, their Table 6). This broad agreement suggests 
that the ADS can by itself generate useful statistics on 
the adoption rate and citation impact of astro-ph. 

Eor papers published in 2002, I repeated the pro¬ 
cedure described above for 13 different journals span¬ 
ning the globe and covering a broad range of ISI impact 
factors^. For three major astronomy journals (ApJ, MN¬ 
RAS, and A&A) I also tracked the annual rise in the 
adoption rate of astro-ph from 1992 to 2004, to look for 
differences in the preprint posting habits of these author 
communities. 

3 Results & Discussion 

The rise in the use of astro-ph over the past decade 
has led to a major shift in the way astronomical research 
is disseminated, and it has had a dramatic impact on the 
citation rates of posted papers as a consequence. In Fig¬ 
ure 1, I show the fraction of papers posted to astro-ph 


^The Institute for Scientific Information (ISI) impact factor, 
tabulated annually for each journal, measures the average 
number of citations per paper per year during the first two years 
after publication. 


for three major astronomy journals from 1992 (astro-ph 
began in April of that year) to 2004. For all three jour¬ 
nals, the adoption rate of astro-ph grew steadily into 
the late 1990’s and then started to level off over the past 
few years. Authors of papers appearing in the ApJ and 
MNRAS have adopted astro-ph at roughly the same rate 
over this time period, while authors publishing in A&A 
have generally been slower to adopt it. Current adop¬ 
tion rates for MNRAS and the ApJ have leveled off near 
70-80%. As noted by Schwarz & Kennicutt, this is sim¬ 
ilar to the fraction of authors who allow their articles 
to be posted in preprint form on the ApJ website (with¬ 
out any additional work by the author). This service was 
initiated by the ApJ in 2002, and may have actually con¬ 
tributed to the limited growth in astro-ph submissions 
in recent years by authors who considered it equivalent 
to astro-ph (MNRAS did not start a similar service until 
2004). The adoption rate of astro-ph among A&A au¬ 
thors has grown more slowly and currently stands near 
60%, a value the ApJ and MNRAS both reached in 2000. 
Within the next 5 years, the use of astro-ph seems likely 
to become almost universal among authors of papers in 
these major astronomy journals. 

A broad survey of the adoption rate and citation im¬ 
pact of astro-ph on papers published in 2002 for a wide 
variety of journals is summarized in Table 1. The sur¬ 
vey includes high-impact multidisciplinary journals like 
Nature and Science, as well as a selection of astronomy 
journals published in various parts of the world with a 
wide range of impact factors. The topical journals So¬ 
lar Physics and Icarus were included to try to elucidate 
the low adoption rate found by Schwarz & Kennicutt 
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Table 1: The citation impact of astro-ph for various journals. 


Journal 

Impact 

Factor 

astro-ph 
# (citations) 

non-astro-ph 
# (citations) 

Adoption 

Rate 

Citation 

Impact 

Nature. 

30.432 

13 

33.4 ±9.4 

97 

6.2 ±0.7 

0.12 

5.4 ± 1.6 

Science. 

26.682 

13 

31.9 ±9.0 

31 

6.4 ± 1.2 

0.30 

5.0 ± 1.7 

ApJ. 

6.187 

1670 

14.9 ±0.4 

661 

7.1 ±0.3 

0.72 

2.1±0.1 

AJ. 

5.119 

327 

13.9 ±0.8 

182 

7.8 ±0.6 

0.64 

1.8 ±0.2 

ApJS. 

4.749 

68 

18.5 ±2.3 

58 

7.3 ± 1.0 

0.54 

2.5 ±0.5 

MNRAS. 

4.671 

809 

13.1 ±0.5 

254 

3.8 ±0.3 

0.76 

3.5 ±0.3 

A&A. 

3.781 

1034 

9.4 ±0.3 

802 

4.6 ±0.2 

0.56 

2.0 ±0.1 

Icarus. 

3.009 

11 

4.1 ± 1.4 

235 

1.9 ±0.2 

0.04 

2.1 ±0.7 

PASP. 

2.830 

62 

10.9 ± 1.4 

76 

3.4 ±0.4 

0.45 

3.2 ±0.6 

PASJ. 

1.996 

67 

5.9 ±0.8 

63 

3.8 ±0.5 

0.52 

1.6 ±0.3 

SoPh. 

1.875 

11 

2.8 ± 1.0 

168 

3.6 ±0.3 

0.06 

0.8 ±0.3 

PASA. 

0.898 

24 

3.8 ±0.9 

41 

2.0 ±0.4 

0.37 

1.9 ±0.6 

Ap&SS. 

0.383 

47 

1.6 ±0.3 

265 

0.5 ±0.1 

0.15 

2.9 ±0.6 


for ApJ papers in the subfield that included solar astro¬ 
physics and planetary science. The most striking feature 
of Table 1 is that in almost every journal surveyed, pa¬ 
pers posted to astro-ph are cited significantly more often 
than papers that are not posted. For most of the major 
astronomy journals, astro-ph papers are cited between 
1.6 and 3.5 times as often as non-astro-ph papers. The 
median boost is about a factor of 2, which is compara¬ 
ble to what was found by Schwarz & Kennicutt for ApJ 
papers. 

Astronomy papers published in the high-impact jour¬ 
nals get an even larger boost from being posted to astro- 
ph. Despite a significantly lower adoption rate, astron¬ 
omy papers appearing in Nature and Science that are 
also posted to astro-ph are cited about 5 times more of¬ 
ten than papers that are not posted. This extra boost 
may come from a kind of “brand recognition” associ¬ 
ated with these high-impact journals, capturing an even 
broader audience than an astro-ph paper published in 
one of the other journals. High-impact journal papers 
that are not posted to astro-ph have citation rates com¬ 
parable to non-posted ApJ papers, and are actually cited 
less often than major astronomy journal papers that are 
posted to astro-ph. Similarly, astro-ph papers that ap¬ 
pear in journals with the lowest impact factors still get 
a citation boost over non-astro-ph papers near the aver¬ 
age. As expected, the absolute citation rate is roughly 
correlated with the ISI impact factor, but the boost in 
citations due to astro-ph does not change by much across 
a wide selection of astronomy journals. 

The only papers in this survey that did not receive 
a significant boost from being posted to astro-ph were 
those published in Solar Physics (SoPh). Schwarz & 
Kennicutt noted that the ApJ papers with the lowest 
adoption rate of astro-ph were in the solar system (SS) 
subfield, which included solar astrophysics and planetary 
science. The low adoption rate by itself may not explain 
the lack of a citation impact for SoPh since the adoption 
rate is even lower for Icarus papers, which are still cited 
twice as often when posted to astro-ph. An alternative 


explanation is that relatively few solar astrophysicists 
learn about new research through astro-ph. It is simply 
not yet part of the culture in this subfield. 

4 Conclusions 

Across a wide selection of major astronomy journals, 
papers that are posted to astro-ph are cited about twice 
as often as papers that are not posted. As the single 
source containing most of the new research to be pub¬ 
lished in refereed journals around the world, the astro-ph 
preprint server appears to be the method that most as¬ 
tronomers now use to keep up with the literature. If ci¬ 
tation rates are any indication of the assimilation of new 
research by the astronomical community, then astro-ph 
seems to be the best single form of advertising available. 
Editors who want to maximize the impact factor of their 
journals should encourage authors to post their preprints 
to astro-ph, and authors in subfields where astro-ph has 
not yet been adopted should consider the advantages 
that other subfields have already discovered. 

This research has made use of NASA’s Astrophysics 
Data System and was supported by the National Sci¬ 
ence Foundation through an Astronomy & Astrophysics 
Postdoctoral Fellowship under award AST-0401441. 
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